MULTI-EXCITED RANDOM WALKS ON INTEGERS 



By Martin P.W. Zerner 

Abstract. We introduce a class of nearest-neighbor integer random 
walks in random and non-random media, which includes excited random 
walks considered in the literature. At each site the random walker has a 
drift to the right, the strength of which depends on the environment at 
that site and on how often the walker has visited that site before. We 
give exact criteria for recurrence and transience and consider the speed 
of the walk. 

1. Introduction 

The results of the present paper are best illustrated by the following ex- 
ample. 

Example 1 . We put two cookies on each integer and launch a nearest neigh- 
bor random walker at the origin. Whenever there is at least one cookie at 
the random walker's current position, the walker eats exactly one of these 
cookies, thus removing it from this site, and then jumps independently of its 
past to the right with probability p and to the left with probability 1 — p, 
where p E [1/2, 1] is a fixed parameter. Whenever there is no cookie left at 
the random walker's current position, the walker jumps independently of its 
past to the left or right with equal probability 1/2. 

We shall show a phase transition in the recurrence and transience behavior 
of the walk, see Theorem 1121 If 1/2 < p < 3/4 then the walker will visit 
its starting point almost surely infinitely often. However, if p > 3/4 then 
the walker will visit almost surely only finitely many times. Moreover, the 
probability that the walker will never return to is (1 — 2/(2p — 1))+, see 
Figure Q and Theorem ^| Finally, for all p < 1 the walk has zero speed, 
even if it is transient, see Theorem 1191 □ 

This example can be formalized and generalized as follows. A cookie 
environment is an element 

^ = {Hz, .)).>0,,, G := ([1/2, 1]^)" . 
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Figure 1. The probability that a random walker will never 
return to its starting point if there are two cookies with pa- 
rameter p each at each integer. 

We will refer to uj{z, i) as to the strength of the i-th cookie at z. This is the 
probability for the random walker to jump from z to z + 1 if it is currently 
visiting z for the i-th time. T. Komorowski suggested to consider the cookies 
as bribes which push an otherwise unbiased walker to the right. 

More formally, given a starting point x G Z and a cookie environment 
ui G VL+, we consider an integer valued process (X„)„>o on some suitable 
probability space {VL^T.Px^S) for which the process of its history {Hn)n>o 
defined by iJ„ := {Xm)o<m<n is a Markov chain, which satisfies Pj.',a;-a-s. 

Px,c.[Xo = x] = 1, 

PxAXn+i = Xn + l\Hr,] = #{m < n I X„ = X„}) , 

P.AXn+i = X^-l\Hr,] = 1 - a; #{m < n I = XJ) . 

Note that itself is in general not a Markov chain since its transition 

probabilities depend on the history of the process. In Example ^ we have 
chosen x = as starting point and the cookie environment u G f2+ with 
uj{z) = {p,p, 1/2, 1/2, 1/2, . . .) for all z e Z. 

This model generalizes in part one-dimensional excited random walks 
(ERW) and random walk perturbed at its extrema, also called pq walks, 
see Benjamini- Wilson jT] and Davis |2| for results and references, regarding 
also continuous space and time analogues. For higher dimensional ERWs see 
P, Kozma 0, and Volkov [lU]. 

The intersection of our model, which we call multi-ERW, with one-dimen- 
sional ERW as defined in |ilj and deals, in our language, with cookie 
environments of the form u{z) = [p, 1/2, 1/2, 1/2, . . .) for all 2; G Z, where 
p G [1/2, 1] is fixed. In such an environment the walker is excited, i.e. biased 
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to the right, only on the first visit to a site. We call such random walks 
once-excited. 

The novelty of our model of multi-ERW is that it permits different levels 
of excitement for different visits to a site. Moreover, the excitement levels 
may vary randomly from site to site, see Section |3 for details. While once- 
ERW is recurrent for all p < 1 (see Pfl p. 86]), multi-ERW exhibits a more 
interesting recurrence and transience behavior, as highlighted in Example ^ 

Our motivation for the study of multi-ERW on integers came from the 
problem posed at the end of [Tj, as to whether once-ERW on 1? has positive 
speed. Although we do not see how to prove this, morally, this should be 
true if once-ERW on a strip Z x {0, . . . , A;} has finite speed for k large enough. 
Moreover, once-ERW on a strip of finite width should roughly behave like 
multi-ERW on Z with a finite number of cookies per site. 

A second source of motivation was to find a unifying model which includes 
both once-ERW and random walks in random environments (RWRE, see e.g. 
|Z]; [H|; [H]) as special cases, see Remark |21 in Section HI for details. 

Let us now describe how the remainder of the present paper is organized. 
Section |21 provides basic lemmas which will be used throughout the paper. 
After some preparation we will also describe in Remark Q the main idea be- 
hind the proof of the phase transition described in Example ^ In Section El 
we introduce the notion of recurrence and transience of states in fixed envi- 
ronments 10. This will be used in Section which contains our main result 
Theorem ^[ a sufficient and necessary criterion for recurrence in stationary 
and ergodic environments. In Section El we investigate random walks which 
one after the other live on the environment left over by the previous random 
walk. Section El is devoted to a strong law of large numbers for the walk in a 
stationary and ergodic environment. Section [71 deals with the monotonicity 
of the return probability and the speed, two quantities, which are explicitly 
computed in the last section for the case in which the excitement is gone 
after the second visit. 

2. Notation and Preliminaries 

Let 

Tfc := inf{n > | X„ = A;} 

be the first passage time of k. The following lemma will be generalized in 
Lemma IT31 bv a different technique. 

Lemma 1. For all x < y < z and all uj G 

z - X 

In particular, by letting x — ^ — oo we see that Tz is Pj^_^-a.s. finite. 
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Proof. We couple (X„)n>o to a simple symmetric random walk (F„)„>o start- 
ing at y such that almost surely y„ < X„ for all n > 0. To this end, we may 
assume that there is a sequence {Un)n>o of independent random variables on 
Q which are uniformly distributed on [0, 1]. If the walk (X„)„ visits at time 
n a site x for the j-time (j > 1) then it moves to the right in the next step iff 
Un < uj{x,j), whereas the walk (y„)„ jumps to the right iff Un < 1/2. Then 
{Xn)n is an ERW in the environment u whereas {Yn)n is a simple symmetric 
random walk. Since u{x,j) > 1/2 we get Yn < X„ almost surely by induc- 
tion over n. Therefore, if (X„)„ exits the interval ]x,z[ in x then so does 
{Yn)n, which has probability {z — y)/{z — x). □ 

The average displacement of the walk after having eaten a cookie of 
strength p is 2p — 1. Therefore, 

6^(00) :=5^(2o.(x,2)-l) 

is the total drift stored in the cookies at site x in the environment u. The 
drift contained in the cookies at site x which have been eaten before time n 
will be called 

#{m<n\Xm=x} 

K--= E (2^(^,0-1)- 

i=l 

To distinguish between recurrence and transience we will distinguish between 
cookies on nonnegative and negative integers. Therefore, we introduce 

Di:=Y,K, D-:=Y,K, and D^:=D^ + D-. 

Lemma 2. Let uj G such that 

1 ° 

(1) liminf- V(2w(?/,1) - 1) > 0. 

y=-i 

Then for all x. A; G Z with k > x, 

(2) E,,4Dt,] = k - X. 

Note that for simple symmetric random walk, i.e. for u = 1/2, Dt,. = 
-Px,a;-a.s.. Hence assumption (|T)) is essential. 

Proof. By shifting by a: to the left we may assume without loss of generality 
k > X = 0. Consider the process Mn := Xn — Dn (n > 0). It is standard to 
check that (M„)„>o is a Po,w-Kicirtingale with respect to the filtration {J-'n)n>o 
generated by (X„)„>o. Therefore, by the Optional Stopping Theorem for all 
n > 0, 

= -Eo,i^[^TfcAn] = -E'o,w[-^TfcAn, Tfc < ^] + -E'^cj [Xy^^An, ^ < T^] — i?o,a; [-Dt^ An] 
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and consequently, 

(3) Eo,^ [Z^T, An] = kPo,^ [Tk <n]+ Eq,^ [X^,n < T^] . 

Now consider Q as n — > oo. Since u G the left hand side of ^ tends by 
monotone convergence to Eq^i^[Dt^.]. Moreover, the first term on the right- 
hand side goes to k. Consequently, 

(4) Eo,4Dt,] = k+ lim Eo,4Xn, n < n]. 

n— >oo 

Hence all that remains to be shown is 

(5) lim Eo,,[X,,n<Tfc] =0. 

n— >oo 

Since for all n > 0, 

(6) min X„ < X„l{n < T^} < k Po^-a.s., 

m<Tfc 

(0) will follow by dominated convergence once we have shown that the non- 
negative random variable — min^^y^ has finite i?o,aj-expectation. Denote 
by 7 the left hand side of (Q). Then 

{7)EoJ-mmxJ < Eq42DtJi] 

L m<rfc J 

(8) + Eq^^ - min X^, - min X„ > ^Dr^/^i 

The term on the right hand side of ((Tj) is finite since (@)) and (jH)) imply 
Eo,lj[Dt,^] < k. The term in (jHJ equals 

(9) V iPo.u, - min X^ = ^, Dt^ < 7z/2 

^—■f ' L m<Tk 

Observe that on the event {T_j < T^}, 



Dn > $^(2^(y,l)-l). 

y=-i 

Therefore, © is less than or equal to 



(10) 



j>l y=-i J 



which is finite since due to the choice of 7 only finitely many indicator 
functions in (|lUp do not vanish. □ 

Remark 1. We are now ready to present the idea of the proof of the recur- 
rence and transience behavior in the two-cookie case described in Example 
H This will be made rigorous and more general in Theorem ^| Roughly 
speaking, Q states that an ERW starting at needs to eat k/{2p—l) cookies 
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in order to reach k. Compare this number to the total number 2k of cookies 
available between and k — 1. If 2k < k/{2p — 1) then the walker needs 
to visit once in a while negative integers in order to meet its cookie needs 
because there are not enough cookies available on the positive integers. This 
makes the walker recurrent. 

On the other hand, if 2k > k/{2p — 1) then the walker cannot afford 
to return to infinitely often because on its way back from its up-to-date 
maximum value, say — 1, to the ERW will eat all the remaining cookies 
between and k — 1, thus consuming at least 2k cookies before it reaches 
k. This would be more than the k/{2p — 1) cookies the ERW should eat. 
Therefore, the walker has to be transient. □ 

In the following we are concerned with the probabilities of the events 



that any given site k is visited infinitely often. The following lemma states 
that the behavior of the walk to the right of k does not depend on the 
environment to the left of k nor on where to the left of k the walk started. A 
related result for Brownian motion perturbed at its extrema is [6, Proposition 
1]. Consider the sequences {Tk,m)m>i {k G Z) defined by 



They enumerate the times n at which X„ > k. Note that these times are 
stopping times with respect to {J-'n)n>o- Moreover, they are Pjj^^^-a.s. finite 
{x G Z) since < oo for all r > 0. 

Lemma 3. Let Xi,X2 < k and uji,uj2 G ^2+ such that u)i{x) = uj2{x) for all 
X > k. Then (-^rfc,„)m>o has the same distribution under Px^^ui o,s under 



In the proof of LemmaEland throughout the paper we will use the (strong) 
Markov property for the Markov chain {Hn)n- To this end we need to in- 
troduce notation for the cookie environment left behind by a cookie eating 
random walker. For any uj G and any finite sequence {xn)n<m of integers 
we define ip (tu, {xn)n<m) e ^+ by 

(12) iIj{uJ, {Xn)n<m){x, l) := U}{x,i + #{n < Ul \ Xn = x}) . 

This is the environment we obtain form uj by following the path {xn)n<m and 
removing the bottom cookie in each site visited. Note that in the definition 
of if) we do not remove the cookie from the final site Xm- 



Rk := {Xn = k i.e.} = limsup{X„ = k} {k E Z) 



n,Q '■= -1 and Tfc^m+i : 



inf{?2 > Tk^m \Xn>k}. 
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Proof of Lemma\^ It suffices to show that for all sequences (?/m)m>i with 
Hm ^ k {m > 1) and for all M > 1, 

(13) Pxi,lji[^m] = Px2,oJ2[^m], 

where 

Am ■■= Am iiy^U>i) := {{Xr.j';^^, = (Uiii} (M > 1). 

So fix such a sequence (|/m)m>i- For M = 1, (fT^ is trivial since X^-^. ^ = k 
Pxi,uji-^-S- = 1;2). Now assume that (fT^ has been proven for M. Then 

(14) = [C, Am] , 
where by the strong Markov property 

It suffices to show that on Am-, C is equal to a deterministic constant c which 
may depend only on (?/m)m>o and on uji and 0^2 where they coincide, thus 
being independent of i. Indeed, then the right-hand side of (fT^ is equal to 
cPxi,uii[AM]i which is independent of i by induction hypothesis. Since (X„)„ 
is a nearest neighbor walk, C = unless Um+i £ {um + 1, {um — 1) V k}. If 
Vm+i = (i/m - 1) V /c then on Am, 

C = l-ifj {uJi, Hr. j,,) (vm, 1) 

= l-Ui {yM, 1 + # {n < Tk,M I = Vm}) 
= I -UJi (vm, 1 + # {m < M I = yM}) ■ 

Since by assumption uji^i/m) = ^2{yM), C is independent of i indeed. A 
similar argument settles the case Um+i = Vm + 1- n 

3. Recurrence and Transience in Deterministic Environments 

In this section we establish recurrence and transience criteria for fixed 
environments. 

Lemma 4. Let x,y,z & Z with y < z and uo G Then P^^ui-o-s- Ry ^ R^. 

Proof. Denote by Ty r {r > 1) the time of the r-th visit to y. On the event 
Ry all times Ty (r > 1) are finite. Consider the events 

Br := {T, o 6t^^^_^ + Ty^r-i < T,, J (r > 0) 

that the walk visits z between the (r — l)-th and the r-th visit to y. Here 6n 
denotes the canonical shift by n steps on the path space. Since {Br i.o.} C 
and Br G J-'xy it suffices to show by the second Borel Cantelli lemma (e.g. 
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jni Ch.4 (3.2)]) that Px,co-a^-s. Y^r P^A^r+i \ ^Ty,^ = oo on Ry. To this end, 
we use the strong Markov property which imphes that on 

= u;{y,r)P^^,^^^^^^^^^^^^^[T,<Ty] > ^^-^ 

due to Lemma ^ This is independent of r and hence not summable in r. □ 

Proposition 5. Let uo G Vt^ and y E 'L. Then either for all x G Z, 
PxAPy] = or for all x G Z, PxAPy] = ^■ 

If Px,uj[Py] ~ 1 f*^^ all x G Z then we shall call y uj -recurrent. Otherwise, 
i.e. if PxAPy] ~ ^'^^ x G Z, ?/ is called uj -transient. 

Proof of Proposition^^ Let x G Z with PxAPy] > 0- have to show is 

that 

(15) VfcGZ PkARy] = ^- 
By Lemma El for all z > y, 

< PxAPy] = P^APy n Rz] < P.,^[(X„,X„+i) = {z,z- 1) i.o.]. 

Therefore, by the convergence part of the Borel Cantelli lemma, ^^(1 — 
uj{z,i)) = 00 for all z > y. However, since the decisions to jump from z to 
z—1 are made independently of each other under P^^^ (fc G Z), the divergence 
part of the Borel Cantelli lemma then implies that for all G Z and all z > y 
we have P^^^-a.s. R^ C R^-i. Since the opposite inclusion holds anyway due 
to Lemma m we have 

(16) V/c G Z yz>y R, ^= Ry. 

Since Ry G (U2>o •^^"z) martingale convergence theorem yields that 

Px,UJ~'^-'^- 1 

1r = lim Pj.,^ [Ry I J^tJ = lim P^,^ [R^ \ J'tJ . 

2— >00 2— +00 

By the strong Markov property this is for all k E Z equal to 

lim P^^^(^^^HtJ [Rz] ^ limPfe,^[P^] ^ lim Pfc_<^ [P^^] =Pk,uj[Ry], 



2— +00 



which implies flT^ because PxARy] > by assumption. □ 

Example 2. Let x G Z and define u G by uj{y,i) = 1/2 if ?/ 7^ 
and ^^(O,^) = 1 — (z + 1)~^ for all i > 1. Since X]i(^ + 1)~^ converges, the 
Borel Cantelli lemma implies that negative integers are w-transient. On the 
other hand, nonnegative integers are a;-recurrent because simple symmetric 
random walk is recurrent. □ 
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Lemma 6. Let lu E such that is uj-transient. Then 

K^oo K 

Proof. Since and D^^ are functions of (Xt-o^)^^q and {uj{x))x>o "we may 
change uo due to Lemma El at negative sites without changing cu-transience 
of and -Eq.w [-^Ta-] • Hence we may assume without loss of generahty that 
uo satisfies (P). For A; > 1 consider the possibly infinite stopping time 

(Tfc := To o dTk_^ + Tfc_i and the event := {ak < Tk} 

that the walk after hitting /c — 1 for the first time, returns to before it 
reaches k. Note that G Tt,,- Since is Po,w-a-s. transient, A^ occurs Po,a;- 
a.s. only for finitely many fc's. Hence by the second Borel Cantelli lemma. 



(17) 



fc>l 



Now let e > 0. Omitting in ()17j] those fc's which are not elements of the set 
Se := {k>l\Yk> e/k], where Yk := Po,a. [^fc I ^n.^] , we obtain 



^ ^ < OO Po,a;-a.S.. 



Consequently, has Po,^-a.s. upper density 0, i.e. #({1, . . . , K}nSe) / K 
as — > OO. Therefore, by dominated convergence. 



:i8) = lim Po,. 



#({i,...,ir}n^, 

K 



1 ^ 

hm J2p,^^[Y,>e/k]. 



k=l 



By the strong Markov property, Po,tj-a.s. 
Yk = P 



k-l,4,[u,HT^_^^ 



[To<Tk] < - 
k 



due to Lemma H Therefore, 

Eo,^[Yk] = Eo,^[Yk, Yk > e/k] + Po,.[n, ^ < e/k] < ^Po,.[n > e/k] + | 
and hence 

P^,^[Yk> e/k]>kE^^^[Yk]~e. 
Substituting this into (fTH|) yields 

1 ^ 1 ^ 

> limsup — ^(/i;Po,a;[>fc] -^^) = -£ + limsup — ^ /cPo,a;[A]. 



k=l 



K—fOo 



k=l 
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Letting e \ gives 

1 ^ 

(19) 0= lim J^kPoAAk]. 

k=l 

For abbreviation set := D^^ — _^ for k > 1. This is the total drift 
of the cookies on negative sites which have been eaten between Tk-i and Tk. 
Since = on A| and since Ak G we have 

(20) ^o,.[A^] = E^A^l, Ak] = Eo,^ [EoA^k I -^<xj, A] • 
By the strong Markov property this is equal to 

(21) Eo,^ [Eo,i,(uj,H^^) [^tJ 

where we note that %Ij{uj^H„^) is well-defined on A^ since 0"^ < oo on A^. 
Also observe that on Ak, ip {u!,Hcr^) differs only at finitely many sites from 
u and therefore satisfies since uj does so. Hence we may use Lemma |21 
and < Dt^ to conclude from ^ and (EH) that Eq^A-^] < kPo^Ak]. 
Therefore, due to (fT^ . 

k=l 

The claim now follows from Eo^^ [Etk] = see Lemma and Dt^ = 



Lemma IHl and D^^ < Ylx=o imply the following sufficient criterion for 



21 ana Uj,^ ^ 2_ 
recurrence. 

Corollary 7. is uj-recurrent if 



1 

liminf — S^ 5''{uj) <l 

We conclude this section by showing that the probability of never returning 
to the starting point is positive whenever the starting point is a;-transient. 
In Section |H1 we shall explicitly compute this probability in some cases. 

Lemma 8. // is uj-transient then Po,a;[V^ > : X„ > 0] > 0. 

Proof. Since is cj-transient and since all positive integers are Po.^j-a.s. even- 
tually hit by the walk, we have Po,w-a-S- > for n large. Now we 
distinguish two cases. 

If 1 is w-recurrent then it follows from the divergence part of the Borel 
Cantelli lemma that ^^(1 — ^^(l,^)) < oo. Since is cj-transient this implies 
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that 

Po,..[Vn>0: X„>0] = a;(0, l)Pi,^ [Vn (X„ = 1 ^ = 2)] 

> u;(0,l)JJ 0^(1,2) > 

i>0 

as required. 

If 1 is cu-transient then there is some K > and a nearest neighbor path 
{xn)n=o of integers with xq = and xk = such that 

< P^AHk = (x„)lo, Vn > : X, > 2] = UV, 

where 

^ := Po,.[i^i. = MLo] and := [Vn > : X„ > 2]. 

Hence [/ > and V > 0. Now we are doing some surgery on {xn)n=o 
cutting out the excursions from 1 toward 0. To this end, we let ni, . . . , n^-i 
be the enumeration of the times 1 < n < K for which x„ > 2 or Xn+i > 2 
and set Uk '■= K. Then := {] and yi := Xn^ for 1 < i < k defines a nearest 
neighbor path {yn)n=o, which starts at 0, ends at 2, and is strictly positive 
in between. Therefore, 

Po,.[Vn > : X„ > 0] 
> PoAHk = {ynt=o, ^n>k: X„ > 2] = uv, 

where 

u := PoAHk = {yn)Lo] and := P2,^(.,{,„)„<,) [V^ > ^ > 2]- 

Consequently, it suffices to show that m > and f > 0. By Lemma El V = v 
because ijj [u, {xn)n<K) (z) = ip (w, {yn)n<k) {z) for z > 2 since (?/„)„<fc visits 
each number > 2 as often as {xn)n<K does. Hence, f > since > 0. 

As for U and u, both are products of finitely many factors of the form 
u){x,i) and 1 — uj{x,i). We have to make sure that none of the factors 
involved in u is 0. Since u!{x,i) > 1/2, only terms of the form 1 — uj{x,i) 
are critical. Having a factor 1 — uj{x,i) = in u, which is not present in U, 
means that the path (a;„)„ jumps to x + 1 after the z-th visit to x whereas 
{yn)n jumps to a; — 1 after the i-th visit to x. Since there are no steps from 
1 to in {yn)ni any such x must be at least 2. However, for any x > 2 all 
the steps from x to x + 1 and from x to x — 1 happen in the same order for 
(x„)„ as for (?/„)n5 thus giving rise to the same factors u;(x, i) and 1 — co'(x, i) 
in U and u. Consequently, m > since [/ > 0. □ 
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4. Recurrence and Transience in Random Environments 

For P a probability measure on fl+, equipped with its canonical cr-field, 
and for X G Z we define the semi-direct product Px := P x Px^w on xQhy 
Px[-] := E [Px,a;[-]]- This is the so-called annealed measure which we get after 
averaging the quenched measure Px^uj over P. Here the expectation operators 
for P and Px are denoted by E and Ex, respectively. 

Not much can be said about recurrence and transience for general P. A 
conclusive answer can be given if {u!{x))x>o is stationary and ergodic under 
P w.r.t. the shift on Z. Stationarity of (ti;(a;))a;>o means that the distribution 
of / (6*^(0;)) under P for x > does not depend on x, where / : is 
defined by 



and 6^ : — >■ is the canonical shift of u to the left by x (x G Z) steps 
as defined by {9^{u)){z) := u{z + x). 

Remark 2. In the special case where uj{x,i) is P-a.s. for all x G Z constant 
in i (but not necessarily constant in x), we get a one-dimensional random 
walk in random environment (RWRE) with a nonnegative drift. The general 
model of RWRE for d = 1, which allows positive and negative drifts, has been 
studied e.g. by Solomon [7j, see also "S] and [TT] for results and references. 
For a unifying model which includes RWRE and ERW we would have to 
replace f2+ by fl± := ([—1, 1]^) . Our methods do not immediately work in 
this case. □ 

Theorem 9. If {uj{x))x>o is stationary and ergodic under F then either every 
X > is P-a.s. uj-recurrent or every x >Q is P-a.s. uj-transient. 

In the first case mentioned above, i.e. when every x > is P-a.s. uj- 

recurrent, we shall call {Xn)n recurrent, in the second case is called 
transient. 

Proof. For all x > and all uj G ^2+ by Lemma |31 



Consequently, taking E-expectations in (j2!2j) and using stationarity yields 



Po[i?o] < E[Po,/(e^H)[i?o]] = E[Po,/h[Po]] = E[Po,.[Po]] = Pq[M- 



Therefore, the inequality in is in fact P-a.s. an equality. Hence, Poj(e^{u)]) [Ro] 
does P-a.s. not depend on x. Moreover, the sequence Poj(6i^((^)) [Po] > 0) 
is ergodic because it is of the form g {{uj{y))y>x) {x > 0). Consequently, this 
sequence is P-a.s. equal to a deterministic constant, which is either or 1 by 




(22) 



-Po,/(0-H)[-Ro]- 



Proposition El 



□ 
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The following lemma shows how the path inherits stationarity and/or er- 
godicity from the environment. 

Lemma 10. If {uj{x))x>o is stationary (resp. ergodic) under F then 

is stationary (resp. ergodic) under Pq. In particular, for any measurable 
function g on ([1/2, l]^)^o x is the sequence {g{C,k))k>o stationary (resp. 
ergodic) under Pq if the sequence (a;(a;))^>o is so under F. 

Here consists of the environment to the right of k and of the part of the 
trajectory to the right of k. 

Proof. To prove stationarity of ^ we shall show that for all measurable subsets 
B of the codomain of ^, Pq [{^k)k>K ^ B] is the same for all K > 0. For the 
proof of ergodicity we need to show that Po[A] G {0, 1} whenever there is a 
B as above such that 

(23) A = {i^k)k>K e B} for all K>0. 

In both proofs the following identities will be used. For all u G Q+, K > 0, 
and B as above we have by the strong Markov property Po.i^-a.s. 

(24) Po,u.mk>KeB\TTj = PK,^(^^,Hr,^)mk>KeB] 

Since 9^ {ip {oj^Ht,^)) (x) and / (O^ioj)) (x) coincide Po,a)-a.s. for x > we 
can apply Lemma El to see that equals 

(25) Poj{eK{uj)) [{,ik)k>o e B] =: rjxiuj). 
Hence taking i^^o,aj-expectations in (j2H) and yields 

(26) Po,c.[i^k)k>K eB]=7]K{uj). 

If we now take E-expectations on both side of ()26|) we get 

(27) Pomk>KeB] = E [Po,/(^)-H) [(a)fe>o G fi]] 

= E [Po,/(.) [{^k)k>o e B]] , 

if {uj{x))x>o is stationary under P. Hence in this case the left hand side of 
(P7|) does not depend on K, which proves stationarity of {^x)x>o- 

For the proof of ergodicity of C, we assume . Then rjx does not depend 
on K since the left-hand side of fl26|) does not. However, since tjk is a 
function of the form g{{u{x))x>K), the process {r]K)K>o is ergodic if {u{x))x>o 
is so. Therefore, in this case, being independent of K, 7]k is P-a.s. equal 
to a deterministic constant c. Going back from via (f^3|) to we 
obtain that P-a.s. Pq^^ [A \ J-'tk] = c. However, given u, A E o- {[Jj^ J^Tk)- 
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Therefore, by the martingale convergence theorem, Po,a;-a.s. Pq.w [A \ J^Tk] ~^ 
lyi as K ^ oo. Hence, either Pg-a-s. c = Pq^^^ [A \ J^Tk\ = or Po-a.s. 
c = Po,^ [A I Ttk] = 1- Integration w.r.t. Pq gives Po[A] e {0, 1}. □ 

The next result deals with the maximal cookie consumption per site. 

Lemma 11. // {uj{x))x>o is stationary under P then Eq[D^] < 1 for all 
x>0. 

Proof. Let x > 0. For u given, the distribution of depends only on 
the distribution of {XrQ „^)m>o- Therefore, we may assume due to Lemma El 
without loss of generality, that (0) is P-a.s. fulfilled. Let < k < K. Then 
Po-a.s. 

K-l K-l-k K-l-k 

y=0 y=0 y=0 

since Ty^k < Tk for y < K — k. Consequently, we obtain from Lemma El 

K-l~k 

K = Eo[DtJ > E ^0 

due to stationarity of the sequences {DTy+k^y>o {k > 0), which we get from 
Lemma ^1 applied for all A; > to 

#{m<Tk{{x„)n)\Xm=0} 

g {{uj{x))^>0,{Xm)m>o) ■= ^ (2t^(0, ?) - 1) . 

i=l 

Therefore, Eo[D^^_^J < K/{K-k). Letting K oo gives Eo[D^^^J < 1 for 
all k > 0. Monotone convergence as — cxd then yields the claim. □ 

The second part of the following theorem classifies recurrent and transient 
walks. 

Theorem 12. Assume that {uj{x))x>o is stationary and ergodic under P. 
Then 

(28) Eo[D^] = mm{l,E[6^]} forallx>0. 
Moreover, if 

(29) P[cu(0) = (1,1/2,1/2,1/2,...)] <1 
then 

(30) {Xn)n>o is recurrent if and only z/E [S^] < 1. 

Obviously, if (j^^ fails then Xn = n Po-a.s. for all n, which makes the walk 
transient although E[5°] = 1. 



J- II 



{K - k)Eo 



D 



T 



x-'rk 
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Proof. Lemma El applied to 



g {{uj{x))^>o, {Xm)m>o) 



#{m\xm= 

1=1 



:0} 



{2u{0,i) - 1) 



yields that {D^)k>o is stationary. Therefore, we may assume for the proof of 
that X = 0. Moreover, since Ir^ and D^^ are functions of {uj{x))x>o and 
(X^g m)m>o we may assume thanks to Lemma El without loss of generality 
that the assumption (Q) is satisfied for all u G ^2+. 

Due to Theorem El (Xn)n is either recurrent or transient. If it is recurrent 
then the walker will eat Pq-^.s. all the cookies at 0, which results in = 5*^, 
thus showing Eo[(5°] = ^o[^i]- Lemma im then yields E < 1 and 

Now we assume that the walk is transient. Then by stationarity of (D^)jt>o, 
see above, 



K-l 



Eo[d: 



° 1 

ooJ 



E 



fc=0 



1 

K 



.fc=0 



> E 



K 



Since i?o,w \Dtk\ — Eo,ui [Dtk] /-^ = 1; see Lemma El we get by dom- 
inated convergence and Lemma El that i?o[-D^] > 1- Since the opposite 
inequality holds due to Lemma ITTl we conclude 



(31) 



Now consider the event 



E,[D\ 



° 1 

ooJ 



1. 



^:=|E(2a;(0,*)-l)>o| 



that has not all its drift stored in its first cookie. We claim P[S'] > 0. 
Indeed, otherwise 1 > ¥\5^] since we excluded the degenerate case in which 
the first cookie has P-a.s. parameter 1. However, because of 5" > Z)^ this 
would contradict (|^. 

By Lemma El P-a.s. Po,<^[Vn > : X„ > 0] > 0. Therefore, since P[^] > 
we have 

< E[Po,.[Vn>0: X„>0],5]=Po[{^^ = 2^(0,l)-l}n5] 
< Po\Dl<5\ 

Since < 5° this implies £'o[P'^] < Eq[5\ From this we obtain by (jSH) 
that 1 < E[5°] and ^ as required. □ 
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5. Eating left-overs 

Assume that {uj{x))x>o is stationary and ergodic. Then by Theorem IHl 
{Xn)n>o is either recurrent or transient and Theorem IT^ tells us which is the 
case. 

Let us assume that {Xn)n>o is transient. Then the walk will visit each site 
X G Z Po-a.s. only a finite number of times. Hence uj2 ■= 'ipiuj, (X„)„<oo), 
with a straightforward extension of definition (jl2p to infinite sequences, is 
Pg-a-s. well defined and consists of the cookies left over by the random walk. 
So we may start a second ERW {Xn^)n>Q in the environment 002. Since 
(ci;(a;))a;>o was stationary and ergodic, so is {uj2{x))x>o due to Lemma ITUl 
applied to 

g {u{x))x>o, {xm)m>o) ■= (t^ (0, i + #{m > | x.^ = 0})) .>;^ . 
(2) 

Consequently, also (X„ )„>o is either recurrent or transient. Moreover, due 
to (PHj) and (IHUj) the first random walk has reduced the expected total drift 
stored in the cookies at any site x > by 1. If the total drift stored in the 
cookies, which were left over by the first walk, is less than 1 then {Xn^)n>o 
will be recurrent due to Theorem ^1 If it is larger than 1 then it will be 
transient and will leave behind another stationary and ergodic environment 
LU3 := ip{uj2, {Xn )n<oo), in which we can start a third ERW (X„ )„>o. 

This can be iterated. E.g. if K[6^] is finite but not an integer (to avoid ex- 
ceptions related to the one ruled out in ((221)) then the first [IE[(5°]J ERWs will 
almost surely be transient and the next one will almost surely be recurrent 
and will eventually eat all the cookies on Nq. 

6. Strong law of large numbers 

Theorem 13. If {uj{x))x>q is stationary and ergodic under F then Po-a.s. 

]^ _^ 

lim — - = y := — > 0, where u := > Pq [Ti+i — T,,- > j] G [1, 00]. 

i>i 

Roughly speaking, u is the expected time it takes a walker who has just 
arrived at 00 to reach level cxd + 1. One could phrase the proof of Theorem 
ITT?1 in terms of a limiting distribution of the environment viewed from the 
particle. The following proof is a bit more elementary. 

Proof. We shall show that Pq-^.s. T^/k u a.s k 00. It is standard (see 
e.g. pin Lemma 2.1.17]) that this implies that X^/n converges Po-a..s. to 
1/u. Observe that Pq-^.s. 

k-l 

(32) Tk = J2T^+l-T^. 

i=0 
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Consequently, 

rp k—1 

(33) lim inf — > sup lim inf — N ((Tj+i — Tj) A t) . 

fc^oo k t>o fc-^oo k ^ — ^ 

— i=t 

Applying Lemma ITUl for all t > to 

g {{u{x))cc>0, {Xm)m>o) ■= (Tf+l - Tt) {{Xm)m>o) A t 

yields that ((Tj+i — Tj) A t)^>^ is stationary and ergodic for all t > 0. There- 
fore, by the ergodic theorem, the right-hand side of is equal to 

t 

supEo[(Tt+i-Tt) At] = supVPo[(Tt+i-Ti) At > j] 

- J=l 

t t 
= sup Po [{Tt+i - Tt) Aj> j] = sup Po K+i - Tj > j] = u, 
- J=l - J=l 

where we used in the second to last inequahty stationarity of ((Tj+i — Tj) A j)j>j 
for all j. On the other hand, implies 

limsup-^ = limsup-^^lT,+i-T,>j 

^ k-1 

(34) < ^limsup-^lT,+i-T,>i. 
Due to Lemma ^1 applied to 

g ((u;(x)):r>o, {Xm)m>o) ■= 1 {(^j+l - Tj) {{Xm)m>o) > j} 

the sequences (lTi+i-ri>i) j^^-, j > 1, are stationary and ergodic. Conse- 
quently, by the ergodic theorem, the right-hand side of (pij) is Po-a.s. equal 
to u, too. □ 

Remark 3. The one-dimensional model under consideration can be ex- 
tended to higher dimensions > 1 by letting a;(x, i) G [0, l]^'* (x G Z'', i > I) 
be a vector of transition probabilities to the 2d neighbors of x in Z^. In the 
case where uj{x), x G Z"', are i.i.d. under P, a straightforward adaptation of 
a renewal structure technique introduced by Sznitman and Zerner for ran- 
dom walks in random environments (RWRE) gives the Po-a.s. convergence of 
(X„ ■ i)/n towards a deterministic limit on the event {lim„^oo ■ ^ = +oo}, 
where i is any direction in M.'^, see and flTj Theorem 3.2.2]. Here we 
assume that none of the transition probabilities is equal to 0. In this case 
Lemma IHl and its higher dimensional analogue (see (1.16)]) are easy to 
obtain. □ 
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Figure 2. Transforming paths from yi to z into paths from 
+ 1 to z. 

7. MONOTONICITY 

Monotonicity resuhs are often difficuh to obtain for processes in random 
media since standard couphng techniques, similar to the one used in the 
proof of Lemma ^ and Example El see below, tend to fail. The following 
result shows that, roughly speaking, starting further to the right, helps to 
reach a goal located to the right sooner. 

Lemma 14. (Monotonicity w.r.t. initial point) Let uo G — oo < x < 

Vi ^ 1/2 ^ z < oo, Hi, 1/2 G Z, and t G [0, oo]. Then 

(35) Py,ATz <T,At]< Py,,4T, < A t]. 

Here we define Too = T^oo = oo. 

Proof. By continuity it is enough to show the claim for z < oo. Moreover, 
by induction it suffices to show the statement for 1/2 = yi + I. So assume 
2/2 = ?/i + 1- For yi < z denote by the set of all finite nearest-neighbor 
paths vr = (x„)„<m, m > 0, which start at Xq = yi, end ai Xm = z and 
do not hit z in between. Any such path vr can be uniquely written as the 
concatenation n = (i?i, Ai, B2, A2, . . . , -Bj(7r), ^j(7r)) for some j(7r) > 1, where 
Ai and Bi {i < ^(vr)) are nonempty nearest-neighbor paths such that the 
Aj's contain only points > yi ("Above yi") and the i?j's contain only points 
< yi ("Below yi ). Then the function $ : E^^ ^ n^^+i defined by 

$(Si, Ai, B2, A2,..., B,, Aj) := {Ai, Bi, A2, B2,..., Aj), 

see Figure d is well-defined and surjective. This function cuts out the last 
excursion Bj from yi downward but otherwise only rearranges pieces of tt 
without changing the relative order in which the points above yi are visited 
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nor the relative order in which the points below yi are visited. Therefore, 
for any vr G 11^^ , 

Py„u [Ht. = vr] = P,,+i,^ [Ht^ = $(7r)] ■ [Ht^^^, = + 1)] , 

where u' := ipiu, {Bi, Ai, . . . , Aj(jr)_i, yi)) is the environment vr faces 

before it starts its excursion Bji^^^y By summing over all possible excursions 
i?j(7r) we get for all vr G 11^^, 

Since $ is surjective this means that for all vr G n^^^_^, 

(36) P,„^ [i/T. G $-'({vr})] = P,,+i,. [i/T. = vr] . 

Now denote by Ily_^{x, t) the set of paths vr in 11^^ which do not visit x before 
z and which make at most t steps. Then the right-hand side of (jH^I) can be 
written as 

(37) P,,+i,^ [Ht^ G n^,+i(a;,t)] = P,„. [//t. G ^"^ (n^^+i(x, t))] 

due to (jnni)- Cutting out an excursion does not make a path longer nor does 
it make a path visit x if the path did not do so before. Therefore, 

$-1 (ff,,+i(x,t)) D ($ (n^,(x,t))) D n^,(x,t). 

Consequently, the right-hand side of (jTfjl is greater than or equal to the 
left-hand side of □ 

Roughly speaking, the following result states that increasing the strength 
of some cookies does not slow down the walk. Here we denote by < the 
canonical partial order on Q^, i.e. Ui < U2 if and only if LUi{x,i) < U2{x,i) 
for all a; G Z and alH > 1. 

Lemma 15. (Monotonicity w.r.t. environment) Let 001,002 G ^2+ with ooi < 
002 and —00 < X < y < z < +00, y G Z, and t G N U {c>o}. Then 

(38) P,,^, [T, < T,. A t] < P,,,, [T, < A t] . 

Intuitively, this result seems to be clear. However, the following example 
shows that the naive coupling approach to prove monotonicity w.r.t. the 
environment fails. 

Example 3. Let uoi,uo2 G fi+ with uOj{x,l) = pj and O0j{x,i) = 1/2 for 
X G Z, i > 2 and j = 1,2, where 1/2 < pi < p2 < I. Thus ooi < 002. There 
does not seem to be a simple way to couple like in the proof of Lemma ^ 
two ERWs {Xn'')n and {Xn^)n in the environments ooi and 002, respectively, 
such that Xn^ < Xn^ for all > almost surely, as we shall show now: 

Again, let ?7„, n > 0, be a sequence of independent random variables 
uniformly distributed on [0, 1]. If the walk {Xn'^)n {j = 1, 2) visits at time n 
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Figure 3. How (X„ ')n (dashed), which eats weak cookies, 
might overtake {Xn^)n (sohd), which eats strong cookies, see 
Example El Sites which are visited for the first time are encir- 
cled accordingly. 

a site for the first time then it moves to the right in the next step iff Un < Pj- 
If it has visited the site it is currently at at least once before than it moves to 
the right iff ?7„ < 1/2. Clearly, this defines two ERWs in the environments 
uJi and UJ2. However, Xg^'* > X^^ on the event 



Proof of Lemma^^ We assume that t is finite. The case of t = oo follows 
then by continuity from the finite case. 

By time t the walker can eat only cookies which are among the first t cookies 
at sites which are within distance t from the starting point y. Hence we 
may assume that uji and uj2 differ in the strength of only a finite number 
r of cookies. By induction it suffices to consider the case r = 1. So let us 
assume that uji{u,i) = uj2{u,i) for all {u,i) G (Z x N)\{(f,j)}, where (f, j) 
denotes location and number of the only cookie which might be stronger in 
UJ2 than in ui. We shall refer to this cookie as to the crucial cookie. Since 
for the event {T^ < Tj, A t} only cookies between x and z matter we may 
additionally assume x < v < z. Denote by 5* the time of the j-th visit to v. 
This is the time at which the walk reaches the crucial cookie. Then for any 



(39) P,,^, [T, < T, A t] = P,,^, [T,<T^^t^S]+ Py,^^ [S < < T, A t] . 




□ 



I = 



1,2, 
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Note that the first term on the right-hand side of does not depend on 
i. It therefore suffices to show that the second term is non- decreasing in i. 
By the Markov property the second term equals 

t-2 

(40) Yl ^V'-^ [PvM-.,Hs) [Tz <T,A{t-s)], s = S <T,A T,] . 

s>0 

Decomposition after the next step, in which the strength of the crucial cookie 
comes into play, yields Py^^--a..s. {i = 1,2) 

(41) P. [T, < A (t - s)] 

= (1 - ^i(^> J))^^'-l,VK,^^s+l)[^^ < A (t - s - 1)] 

[T, <r,.A(t-s-l)]. 

However, on {S = s}, 

(42) ^{ui,Hs+i) =^{uj2,Hs+i) 

Pj^^^j-a.s. because at time S the walker reaches and then eats the crucial 
cookie, thus erasing the only difference between the two environments. More- 
over, we may apply Lemma El with yi = v — 1 and 2/2 = "^^ + 1 to deduce 

that Py^^-^-Ci.S. 

Pv-i,i,{u^,Hs+i)[Tz < A (t - s - 1)] < Pv+i,i,{L,^,Hs+i)[Tz < A (t - s - 1)]. 

Combined with (j^^ and uji{v,j) < uj2{v,j) this implies that (PT|) for i = 1 
is Py,a;i-a-s. less than or equal to PTj) for i = 2. Consequently, (pOj) for z = 1 
is less than or equal to 

t-2 

(43) ^J/.-i [P-M^2,H.) [Tz <T,A{t-s)], s = S <T,A T,] . 

However, the distribution of the above integrand under Ey^^-^ does not depend 
on LJi{v,j) any more. Therefore, we can replace Ey^^-^ in expression PHjl by 
Ey^uj2 without changing its value, thus getting (jlUj) with i = 2. □ 

The following corollaries show that the probability of return to the origin 
and the speed of the walk are monotone increasing in u. 

Theorem 16. The probability Po,a;[Vn > X„ > 0] never to return to the 
initial point is monotone increasing in uo. 

Proof. By the simple Markov property for all uj G ^2+, 

Po,,[Vn > X„ > 0] = cu(0, l)Pi,v,(c.,(o,i)) [Vn > X„ > 0] 

(44) = c^(0,l)Pi,^[Vr2>0X„>0], 

which is monotone increasing in uj due to Lemma IT31 applied to a; = 0, y = 1 
and z = t = 00. □ 
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Theorem 17. Let F be a probability measure on Q"^ such that 

P[{(CJ1,CJ2) G I C^l <LU2}] = 1 

and such that {uJi{x))x>o is stationary and ergodic for i = 1,2. Then Vi < V2 
if we denote by Vi {i = 1,2) the P x PQ^^.-a.s. constant limit of Xn/n as 
n ^ oo. 



Proof. By dominated convergence for i = 1, 2 
Vi = lim 1[Eo,^JXt,/T,,]] 

fc— >oo 



lim E [Eo,^^ [k/Tk]] 



lim E 



Po,u, [Tk < k/t] dt 



The statement now follows from Lemma ^1 with x 
z = k. 



-oo, y = 0, and 
□ 



Open Problem. Are the return probability and the velocity in an appro- 
priate sense continuous in cu? 



8. No EXCITEMENT AFTER THE SECOND VISIT 

In some cases when the random walk behaves on the third and any later 
visit to a site like a simple symmetric random walk one can determine the 
probability that the walk will never return to its starting point and can show 
that the walk has zero speed. 

Theorem 18. If {u{x))x>o is i.i.d. under F such that F-a.s. u!{0,i) = 1/2 
for alli>3 and P[a;(0, 2) = 1/2] < 1 then 

(45) p„iv„ > x„ > 0] - nAo.mm-i). 



E[(2cj(0,2) - 1V(0,1)]' 

Proof. Consider 6^ — D^, the total drift stored in the cookies at which will 
never be eaten by the random walk. On the one hand, by ()28|) 

On the other hand, since the first cookie at is eaten Pq-^.s. right at the 
beginning of the walk and since only the first two cookies at contribute to 
5° we have Pq-s-s. 

50 _ = (2cj(0, 2) - l)l{Vr2 > X„ > 0}. 

Combining these two facts we get 

(46) (E[50] - 1)+ = E [{2uj{0, 2) - l)Po,^[yn > X„ > 0]] . 
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Recall and note that Pi,i^[Vn > X„ > 0] is a function of {lj{x))x>i- 
Therefore, it is independent of uj{0) under P by assumption. This has two 
consequences: Firstly, taking E-expectations in (ji^ yields 

(47) Po[Vri > X„ > 0] = E[cu(0, l)]Pi[Vn > X„ > 0]. 
Secondly, substituting (ji^ into (jlUj) gives 

(E[5°] - 1)+ = E [(2c<;(0, 2) - l)cj(0, 1)] Pi[Vn > X„ > 0]. 
Combined with ()47|1 this proves the claim. □ 

Theorem 19. Let (ti;(x))^>o be stationary and ergodic with uj{0,i) = 1/2 
F-a.s. for all i > 3 and P[cu(0, 1) < 1, cj(l, 1) < 1] > 0. Then 

lim — - = Po-a.s.. 

Proof. By assumption, we can fix e > such that P[Aj] =: a is strictly 
positive and independent of j, where 

A, := {uj{j - 1, 1) < 1 - £, uj{j, l)<l-e} (j > 1). 

Due to Theorem [T^ we need to show that u = oo. To simplify calculations we 
will do a worst case analysis by maximizing the strength of selected cookies 
as follows. Define Uj G for j G Z by 

(1, 1/2, 1/2,1/2,...) ifx<j-l, 

(1/2, 1/2, 1/2,1/2,...) ifx=j-l, 

(1 - e, 1, 1/2, 1/2, . . .) if X = J, and 

(1, 1, 1/2,1/2,...) ifx>j. 

Now let j > 1. Then 

PK-+1 - T, > j] 
> E [Po,^ [r,+i - T, > J, Xt,_,+i = j - 2] , A,] 

(48) = E [Eo,. [p,, [^.+1 > j] . = J - 2] , A,- . 
Observe that 

where ujj{x) := ip [uj,Ht^) (x) for x > and uJj{x) = iOj{x) for x < 0. 
Moreover, Uj < ujj on {uj{j, 1) < 1 — £:,Xr^_j+i = j — 2}. Consequently, due 
to Lemma El (j48|) is greater than or equal to 

P,-,^, [T,+i > j] E [Po,^ [Xt,^,+i = j - 2] , A,] > Po,^„ [Ti > j] e «. 
Hence it suffices to show that X]j>i -Po.iz^o [^i > j] = -E'o.iDqI^i] — Since 
Ti = 5^(T_fc_i A Ti - r_fc)l{T_, < Ti} 

fe>0 



Uj{x) :- 
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we have 

(49) Eo,^, [T^] = ^ Eo,a., [^0,^0 [T-k-i A Ti - T_k \ ^t_J , T_, < T,] . 



k>0 



For k > 1, the conditional expectation in (|49|) is on {T_k < Ti} by the strong 
Markov property equal to 

(51) > E_,^i,^^^^^H,^^_^^^[T-k-iATo] = 2ik-l). 

Here fj^UI) holds because of C(}o(— A;, 1) = 1- Equation is true since the 
walker eats while traveling from to — /c and back to —k + 1 all the cookies 
between —k and —1, which have strength > 1/2, so that the formula for the 
expected exit time of a simple symmetric random walk from an interval (e.g. 
in Ch. 14.3 (3.5)]) can be applied. Substituting this into yields 



^0,^0 [^1] > 2^(A;-l)Po,.D„[T-fc<Ti] 

k>l 

= 2{l-e)J2ik-l)P-iMAT-k<n 



k>l 



Therefore, since the harmonic series diverges it suffices to show for the proof 
of i?o,(i)o[^i] ~ ^ that for all k >2, 

(52) P-i,oo[T-k<To 



{k-l)k' 

This is done by induction over k. For k = 2, the left-hand side of ()52|1 is 
C(}o(— 1, 1) = 1/2 by definition of Uo. Now assume that (j52p has been proven 
for k. Then 

P-i,u;o[T-k-i < To] = E^i^oo T^k < ^o,^_fc+i,v(tDo,HT_;,+i)[^-'=-i < ^0 

As above, on {T^k < ^0} all the cookies with strength > 1/2 have been 
removed by time T_k + 1 from the interval between —k and —1. Therefore, 
the last expression equals 

P-i,o,[T~k < To\^^ - ^ - k{k + Y) 

by induction hypothesis. □ 

The following example shows that the assumption P[ci;(0, 1) < 1, ti;(l, 1) < 
11 > of Theorem IT9l is essential. 
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Example 4. Let uj{x),x G Z, alternate between (1,1,1/2,1/2,...) and 
(p, 1, 1/2, 1/2, . . .) where 1/2 < p < 1 is fixed. Then PQ-a.s. T^+i — < 3 
for all > 0, which generates a strictly positive speed. □ 

Open Problem. Of course, it is possible to generate a strictly positive 
speed V by choosing uj{x, i) > 1/2 + e P-a.s. for all x G Tj'^, i > 1, where e > 
is fixed. However, are a finite number of cookies with strength > 1/2 (and 
< 1) per site already sufficient to generate positive speed? More precisely, 
for which integers m > 3, if any, is there some 1/2 < p < 1 such that v > 
if P-a.s. for all x G Z, uj{x, i) = p for i < m and uj{x, i) = 1/2 for i > ml 
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